Apparatus and method for segmenting video data in mobile communication terminal

ABSTRACT

In one embodiment, a method for segmenting video data in a mobile communication terminal includes acquiring sensor data periodically together with video data during video shooting, and segmenting the video data based on the acquired sensor data.

CROSS-REFERENCE TO RELATED APPLICATION(S) AND CLAIM OF PRIORITY

The present application is related to and claims priority under 35U.S.C. §119 to an application filed in the Korean Intellectual PropertyOffice on Mar. 2, 2011 and assigned Serial No. 10-2011-0018377, thecontents of which are incorporated herein by reference.

TECHNICAL FIELD OF THE INVENTION

The present invention relates generally to a mobile communicationterminal, and in particular, to an apparatus and method for segmentingvideo data in a mobile communication terminal.

BACKGROUND OF THE INVENTION

Video segmentation is a technique that segments video data for jumpingto a specific playback position within a video and playing the videofrom the specific playback position.

One particular conventional video segmentation technique uses a videoanalyzing method to separate news services by distinguishing speakersthrough a voice analysis or the like, or to notify the change of animage by distinguishing a difference between images.

However, such a video analyzing method may often not provide an adequatesegmentation technique. Therefore, as in the case of a chapteringservice in a Digital Video Disk (DVD) or the like, video data segmentedby an author's arbitrary decision in a contents creating step have beendistributed.

SUMMARY OF THE INVENTION

To address the above-discussed deficiencies of the prior art, it is aprimary object to provide at least the advantages below. Accordingly, anobject of the present invention is to provide an apparatus and methodfor segmenting video data in a mobile communication terminal.

Another object of the present invention is to provide an apparatus andmethod for segmenting video data based on sensor data in a mobilecommunication terminal.

Another object of the present invention is to provide an apparatus andmethod for segmenting video data based on sensor data by storing videodata and sensor data acquired from a variety of sensors, together with aplayback position (or playback time) offset value of the correspondingvideo data, during video shooting in a mobile communication terminal.

Another object of the present invention is to provide an apparatus andmethod for storing a changed sensor data value of a current period incomparison with a previous period and a playback position (or playbacktime) offset value of corresponding video data for each sensor in ametadata storage space within a video file configured with the videodata in a metadata format in a mobile communication terminal.

According to an aspect of the present invention, a method for segmentingvideo data in a mobile communication terminal includes: acquiring sensordata periodically together with video data during video shooting; andsegmenting the video data based on the acquired sensor data.

According to another aspect of the present invention, an apparatus forsegmenting video data in a mobile communication terminal includes: acamera unit for acquiring video data through video shooting; a sensorunit for acquiring sensor data periodically during the video shooting;and a video segmenting unit for segmenting the video data based on theacquired sensor data.

Before undertaking the DETAILED DESCRIPTION OF THE INVENTION below, itmay be advantageous to set forth definitions of certain words andphrases used throughout this patent document: the terms “include” and“comprise,” as well as derivatives thereof, mean inclusion withoutlimitation; the term “or,” is inclusive, meaning and/or; the phrases“associated with” and “associated therewith,” as well as derivativesthereof, may mean to include, be included within, interconnect with,contain, be contained within, connect to or with, couple to or with, becommunicable with, cooperate with, interleave, juxtapose, be proximateto, be bound to or with, have, have a property of, or the like; and theterm “controller” means any device, system or part thereof that controlsat least one operation, such a device may be implemented in hardware,firmware or software, or some combination of at least two of the same.It should be noted that the functionality associated with any particularcontroller may be centralized or distributed, whether locally orremotely. Definitions for certain words and phrases are providedthroughout this patent document, those of ordinary skill in the artshould understand that in many, if not most instances, such definitionsapply to prior, as well as future uses of such defined words andphrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1 illustrates an example configuration of a mobile communicationterminal according to an embodiment of the present invention;

FIG. 2 illustrates an example method for segmenting video data based onsensor data in a mobile communication terminal according to an exemplaryembodiment of the present invention;

FIG. 3 illustrates an example method for playing video data segmentedbased on sensor data in a mobile communication terminal according to anexemplary embodiment of the present invention;

FIG. 4 illustrates an example method for segmenting video data based onsensor data in a mobile communication terminal according to an exemplaryembodiment of the present invention; and

FIG. 5 illustrates an example format of video data according to anexemplary embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIGS. 1 through 5, discussed below, and the various embodiments used todescribe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged mobile communications terminals. Inthe following description, detailed descriptions of well-known functionsor configurations will be omitted since they would unnecessarily obscurethe subject matters of the present invention. Also, the terms usedherein are defined according to the functions of the present invention.Thus, the terms may vary depending on users' or operators' intentions orpractices. Therefore, the terms used herein must be understood based onthe descriptions made herein.

Hereinafter, an apparatus and method for segmenting video data based onsensor data in a mobile communication terminal according to exemplaryembodiments of the present invention will be described.

Although a mobile communication terminal will be described below as oneexample, it is apparent that the present invention can also be appliedto any device that is provided with a built-in sensor (or connected toan external sensor) and is capable of shooting or playing a video.

FIG. 1 illustrates an example configuration of a mobile communicationterminal according to an exemplary embodiment of the present invention.The mobile communication terminal includes a control unit 100, a cameraunit 102, a video processing unit 104, a display unit 106, an input unit108, a video segmenting unit 110, a sensor unit 112, a memory unit 114,and an audio processing unit 118.

The control unit 100 controls an overall operation of the mobilecommunication terminal and processes a function of segmenting video databased on sensor data.

The camera unit 102 includes a camera sensor and a signal processor. Thecamera sensor converts an optical signal detected during video shootinginto an electrical signal. The signal processor converts an analog videosignal from the camera sensor into digital video data. In certainembodiments, the camera sensor may be a Charge Coupled Device (CCD)sensor, and the signal processor may be a Digital Signal Processor(DSP).

The video processing unit 104 generates screen data for displayingcamera video data received from the camera unit 102. The videoprocessing unit 104 includes a video codec (not shown) that codes videodata in accordance with a specified protocol or decodes coded video datainto original video data.

The display unit 106 displays information, such as numerals andcharacters, moving pictures and still pictures, and status informationgenerated during the operation of the mobile communication terminal. Thedisplay unit 106 may be a color Liquid Crystal Display (LCD) or otherdisplay device.

The input unit 108 includes alpha-numeric keys and a plurality offunction keys. The input unit 108 provides the control unit 100 with keyinput data that corresponds to a key pressed by a user.

Upon video shooting, the video segmenting unit 110 segments video databased on sensor data by storing the video data and the sensor dataacquired from a variety of sensors in the memory unit 114, together witha playback position (or playback time) offset value of the correspondingvideo data.

The sensor unit 112 includes one or more sensors. For example, thesensor unit 112 may include a position sensor (for example, a GlobalPositioning System (GPS)), a temperature sensor, an orientation sensor,a noise sensor, and the like. The sensor may be built in the mobilecommunication terminal, or may be configured outside the mobilecommunication terminal and coupled to the mobile communication terminalvia a wired or wireless connection.

The memory unit 114 stores a variety of reference data, instructions ofan executable program for processing and controlling the control unit100, temporary data generated during the execution of various programs,and/or updatable backup data. In particular, the memory unit 114 storesan executable program for segmenting the video data based on the sensordata. In addition, the memory unit 114 may store a video file 116.

The audio processing unit 118 includes an audio codec 107 that processesan audio signal such as a voice signal. In particular, the audioprocessing unit 118 may process an audio signal from the control unit100 and plays the processed audio signal through a speaker, or mayprocess an audio signal from a microphone and provides the processedaudio signal to the control unit 100.

FIG. 2 illustrates an example method for segmenting video data based onsensor data in a mobile communication terminal according to an exemplaryembodiment of the present invention. The mobile communication terminaldetermines whether video shooting is requested according to a user's keymanipulation in step 201. If so, the mobile communication terminaldisplays a sensor list on a screen in order to allow the user to selectone or more sensors to be used to segment video data in step 203. Thesensor list may include a position sensor, such as a GPS device, atemperature sensor, an orientation sensor, a noise sensor, and the like.

In step 205, the mobile communication sensor determines whether one ormore sensors are selected from the sensor list displayed on the screen.For example, if it is intended to check a shooting position of a currentvideo and store a moving path of the video shooting together with thevideo data, the user may select the position sensor and use the selectedposition sensor to segment the video data. When it is determined in step205 that one or more sensors are selected from the sensor list displayedon the screen, the mobile communication terminal drives a camera and theselected sensor(s) in step 207.

In step 209, the mobile communication terminal acquires video data byshooting a video through the driven camera, and acquires sensor dataperiodically through the driven sensor(s). For example, the sensor datamay include a position value, a temperature value, an orientation value,a noise value, and the like.

In step 211, the mobile communication terminal compares sensor dataacquired at a current period with sensor data acquired at a previousperiod with respect to each selected sensor, and checks whether thesensor data value has changed. If so, the mobile communication terminaldetermines that a current playback position (or playtime time) of thevideo data is a playback position (or playback time) requiring the videodata to be segmented based on the sensor data, and stores the changedsensor data value together with a playback position (or playback time)offset value of the video data in step 213. Then, the mobilecommunication terminal proceeds to step 215. As such, while the mobilecommunication terminal shoots the video, it segments the video data bystoring the changed sensor data value of the current period incomparison with the previous period together with the playback position(or playback time) offset value of the corresponding video data withrespect to each sensor. Accordingly, as illustrated in FIG. 4, aplurality of video data segmented based on the sensor data of eachsensor may be created.

As one example, which is illustrated in FIG. 5, the changed sensor datavalue of the current period in comparison with the previous period withrespect to each sensor and the playback position (or playback timeoffset value of the corresponding video data may be stored in a metadataformat in the metadata 504 storage space within the video file 500configured with the video data 502. That is, the changed sensor datavalue and the playback position (or playback time) offset value may bestored separately from the video data within the corresponding videodata. As another example, the changed sensor data value and the playbackposition (or playback time) offset value may be stored within thecorresponding video data.

On the other hand, if it is determined from the sensor data comparisonof step 211 that the sensor data value is not changed, the mobilecommunication terminal proceeds to step 215. In step 215, the mobilecommunication terminal determines whether it is requested to stop videoshooting according to the user's key manipulation. If it is determinedin step 215 that the mobile communication terminal is requested to stopthe video shooting according to the user's key manipulation, the mobilecommunication terminal stores the video data segmented based on thesensor data acquired periodically through the driven sensor(s) in step217. On the other hand, if it is checked in step 215 that it is notrequested to stop the video shooting according to the user's keymanipulation, the mobile communication terminal returns to step 209 andrepeats the subsequent steps.

Thereafter, the mobile communication terminal ends the process of FIG.2.

FIG. 3 illustrates an example method for playing video data segmentedbased on sensor data in a mobile communication terminal according to anembodiment of the present invention. Referring to FIG. 3, the mobilecommunication terminal checks whether video shooting is requestedaccording to a user's key manipulation in step 301. If so, the mobilecommunication terminal displays a sensor list on a screen in order toallow the user to select one or more sensors to be used to segment videodata in step 203. The sensor list may include a position sensor, such asa GPS, a temperature sensor, an orientation sensor, a noise sensor, andthe like.

In step 305, the mobile communication sensor checks whether one or moresensors are selected from the sensor list displayed on the screen. Ifso, the mobile communication terminal plays the corresponding video instep 307 and displays a list of sensor data on the screen, which havebeen previously stored during the shooting of the corresponding videowith respect to each selected sensor. For example, the sensor data mayinclude a position value, a temperature value, an orientation value, anoise value, and the like.

In step 309, the mobile communication terminal determines whether onesensor data is selected from the sensor data list displayed on thescreen. If so, the mobile communication terminal extracts a playbackposition (or playback time) offset value of the video data, which ispreviously stored together with the selected sensor data during theshooting of the corresponding video in step 311.

In step 313, the mobile communication terminal determines a playbackposition (or playback time) of the corresponding video data based on theextracted playback position (or playback time) offset value of the videodata.

In step 315, the mobile communication terminal randomly accesses thedetermined playback position (or playback time) and plays thecorresponding video data. For example, upon video shooting, in the casewhere a video shooting position is checked through a position sensor anda moving path of the video shooting is stored together with the videodata, or the respective videos shot in the above-described manner areedited into a single video and stored, and if the user wants to directlyfind the video shot in a specific area and play the corresponding videowhen viewing the video after the completion of the video shooting, themobile communication terminal may directly jump to the video of thecorresponding area and play the corresponding video, based on the sensordata that is provided from the position sensor and stored together withthe video data during the video shooting.

Thereafter, the mobile communication terminal ends the process of FIG.3.

As such, when the mobile communication terminal shoots the video, thevideo data and the sensor data acquired from the various sensors arestored together with the playback position (or playback time) offsetvalue of the corresponding video data, and the corresponding video datais segmented based on the sensor data. Accordingly, more diverse videoservices may be provided to the user, based on the sensor data. As oneexample, a video search based on the sensor data may be achieved througha video search service. For instance, regarding a video shot by a userwhile traveling France, Germany, and Sweden, and entitled ‘France,’ thecorresponding video could be searched only when a search word is‘France.’ However, according to the embodiment of the present invention,video data related to the corresponding regions within the video filecan be searched and played even when the search word is ‘Germany’ or‘Sweden’. Therefore, the search accuracy and convenience can beincreased.

When the mobile communication terminal shoots the video, the video dataand the sensor data acquired from the various sensors are storedtogether with the playback position (or playback time) offset value ofthe corresponding video data, and the corresponding video data issegmented based on the sensor data. Accordingly, more diverse videoservices may be provided to the user, based on the sensor data (forexample, the position value, the temperature value, the orientationvalue, the noise value, and the like).

While the invention has been shown and described with reference tocertain preferred embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the invention asdefined by the appended claims. Therefore, the scope of the invention isdefined not by the detailed description of the invention but by theappended claims, and all differences within the scope will be construedas being included in the present invention.

1. A method for segmenting video data in a mobile communicationterminal, the method comprising: acquiring sensor data periodicallytogether with video data during video shooting; and segmenting the videodata based on the acquired sensor data.
 2. The method of claim 1,wherein the sensor data comprises at least one of a position value, atemperature value, an orientation value, and a noise value.
 3. Themethod of claim 1, further comprising: when the video shooting isrequested, displaying a sensor list on a screen; and when one or moresensors are selected from the sensor list, controlling a camera usingthe one or more sensors,
 4. The method of claim 3, wherein the sensorlist comprises at least one of a position sensor, a temperature sensor,an orientation sensor, and a noise sensor.
 5. The method of claim 1,wherein the segmenting of the video data comprises: determining whethera sensor data value has changed by comparing sensor data acquired at acurrent period with sensor data acquired at a previous period; and ifthe sensor data value has changed, storing the changed sensor data valuetogether with a playback position or playback time offset value of thevideo data.
 6. The method of claim 5, wherein the changed sensor datavalue and the playback position or playback time offset value of thevideo data are stored in a metadata format in a metadata storage spacewithin a video file configured with the video data.
 7. The method ofclaim 5, wherein the changed sensor data value and the playback positionor playback time offset value of the video data are stored in the videodata.
 8. The method of claim 1, further comprising: when the playback ofthe segmented video data is requested, displaying a sensor list; whenone or more sensors are selected from the sensor list, displaying a listof sensor data used to segment the video data by the selected one ormore sensors; when one sensor data is selected from the list of sensordata, extracting a playback position or playback time offset value of avideo data, which is previously stored together with the selected sensordata; determining a playback position or playback time of acorresponding video data based on the extracted playback position orplayback time offset value of the video data; and randomly accessing thedetermined playback position or playback time and playing thecorresponding video.
 9. An apparatus configured to segment video data ina mobile communication terminal, the apparatus comprising: a camera unitconfigured to acquire video data through video shooting; a sensor unitconfigured to acquire sensor data periodically during the videoshooting; and a video segmenting unit configured to segment the videodata based on the acquired sensor data.
 10. The apparatus of claim 9,wherein the sensor data comprises at least one of a position value, atemperature value, an orientation value, and a noise value.
 11. Theapparatus of claim 9, further comprising a display unit configured todisplay a sensor list when the video shooting is requested, wherein,when one or more sensors are selected from the sensor list, the videosegmenting unit configured to control a camera using the selected one ormore sensors.
 12. The apparatus of claim 11, wherein the sensor listcomprises at least one of a position sensor, a temperature sensor, anorientation sensor, and a noise sensor.
 13. The apparatus of claim 9,wherein the video segmenting unit is configured to compare sensor dataacquired at a current period with sensor data acquired at a previousperiod and determine whether a sensor data value is changed and, if thesensor data value is changed, the video segmenting unit is configured tostore a playback position or playback time offset value of the videodata and the changed sensor data value.
 14. The apparatus of claim 13,wherein the changed sensor data value and the playback position orplayback time offset value of the video data are configured to be storedin a metadata format in a metadata storage space within a video fileconfigured with the video data.
 15. The apparatus of claim 13, whereinthe changed sensor data value and the playback position or playback timeoffset value of the video data are stored in the corresponding videodata.
 16. The apparatus of claim 9, further comprising a display unitconfigured to display a sensor list when the playback of the segmentedvideo data is requested, and display a list of sensor data used tosegment the video data by one or more sensors that are selected from thesensor list; wherein when one sensor data is selected from the list ofsensor data, the video segmenting unit configured to extract a playbackposition or playback time offset value of the video data previouslystored together with the selected sensor data, determine a playbackposition or playback time of a corresponding video data based on theextracted playback position or playback time offset value of the videodata, randomly access the determined playback position or playback time,and play the corresponding video.
 17. A non-transitory computer readablemedium embodying a computer program, the computer program comprisingcomputer readable program code configured to: acquire sensor dataperiodically together with video data during video shooting; and segmentthe video data based on the acquired sensor data.
 18. The computerprogram of claim 17, further comprising code configured to: when thevideo shooting is requested, display a sensor list on a screen; and whenone or more sensors are selected from the sensor list, control a camerausing the one or more sensors,
 19. The computer program of claim 18,wherein the sensor list comprises at least one of a position sensor, atemperature sensor, an orientation sensor, and a noise sensor.
 20. Thecomputer program of claim 17, further comprising code configured to:when the playback of the segmented video data is requested, display asensor list; when one or more sensors are selected from the sensor list,display a list of sensor data used to segment the video data by theselected sensor or sensors; when one sensor data is selected from thelist of sensor data, extract a playback position or playback time offsetvalue of a video data, which is previously stored together with theselected sensor data; determine a playback position or playback time ofa corresponding video data based on the extracted playback position orplayback time offset value of the video data; and randomly access thedetermined playback position or playback time and play the correspondingvideo.